Optical device, control method therefor, and storage medium storing control program therefor

ABSTRACT

An optical device that is capable of reducing eccentric aberration while reducing image blur. A first shake correction unit corrects image blur optically based on a shake amount that is detected by a shake detection unit. A second shake correction unit corrects image blur optically based on a shake amount that is detected by the shake detection unit. The second shake correction unit has a different image blur correction effect from the first shake correction unit. The optical device has a mode in which shake correction is performed using the first shake correction unit without using the second shake correction unit.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an optical device, a control methodtherefor, and a storage medium storing a control program therefor.Particularly, the present invention relates to a shake correctionprocess technology of preventing image blur caused by camera shake etc.by using a plurality of shake correction lenses.

2. Description of the Related Art

Generally, in an image pickup apparatus, such as a digital video cameraor a digital still camera, image blur may be caused by a user's camerashake etc. In order to prevent such image blur, there is a known imagepickup apparatus that reduces image blur by driving a plurality oflenses, which are included in a photographing lens unit for forming animage of a subject, in response to a shake amount of the image pickupapparatus caused by camera shake (see Japanese Laid-Open PatentPublication (Kokai) No. 2001-249276 (JP 2001-249276A)). The image pickupapparatus of this publication moves the lenses in directions differentfrom an optical axis direction in order to reduce image blur.

Incidentally, when a lens is moved in a direction different from anoptical axis direction, an image distorts and a resolution deterioratesdue to eccentric aberration as the shifting amount of the lens from theoptical axis increases.

Optical properties of eccentricity aberration are complicated.Particularly, when two or more lenses are moved simultaneously, theoptical properties become more complicated, which increases difficultyof the correction. Accordingly, a shake correction system that reducesimage blur with two or more movable lenses is desirable to be controlledso as not to move two or more lenses simultaneously from a point of viewof correcting eccentric aberration.

However, even if the system is controlled so as not to move two or morelenses simultaneously in order to reduce eccentricity aberration, sincean image blur correction effect and an image quality deteriorationeffect of one lens are different from that of another lens, it isdifficult to determine how to move each lens.

Accordingly, a conventional optical device and a conventional imagepickup apparatus are difficult to reduce eccentric aberration whilereducing image blur.

SUMMARY OF THE INVENTION

The present invention provide an optical device, a control methodtherefor, and a storage medium storing a control program therefor, whichare capable of reducing eccentric aberration while reducing image blur.

Accordingly, a first aspect of the present invention provides an opticaldevice comprising a shake detection unit, a first shake correction unitconfigured to correct image blur optically based on a shake amount thatis detected by the shake detection unit, and a second shake correctionunit configured to correct image blur optically based on a shake amountthat is detected by the shake detection unit, and configured to have adifferent image blur correction effect from the first shake correctionunit, wherein the optical device has a mode in which shake correction isperformed using the first shake correction unit without using the secondshake correction unit.

Accordingly, a second aspect of the present invention provides a controlmethod for an optical device comprising a step of detecting camerashake, a step of correcting image blur optically by controlling a firstshake correction unit based on shake amount detected in the shakedetecting step, and a step of correcting image blur optically bycontrolling a second shake correction unit of which an image blurcorrection effect is different from that of the first shake correctionunit based on shake amount detected in the shake detecting step, whereinthe control method has a mode in which shake correction is performedusing the first shake correction unit without using the second shakecorrection unit.

Accordingly, a third aspect of the present invention provides anon-transitory computer-readable storage medium storing a controlprogram causing a computer to execute the control method for the opticaldevice according to the second aspect.

According to the present invention, since the optical device obtains theshake detection result by detecting shake applied to the optical device,selects one of the image blur correction effect priority mode and theimage quality priority mode based on the shake detection resultconcerned, and controls to move the shake correction lenses selectivelyaccording to the optical characteristics, i.e., since the optical devicecontrols to move the shake correction lenses selectively inconsideration of the image blur correction effects and the image qualitydeteriorations of the shake correction lenses, the eccentric aberrationcan be reduced according to a shooting condition, and the image blur canbe reduced.

Further features of the present invention will become apparent from thefollowing description of exemplary embodiments with reference to theattached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram schematically showing a configuration of animage pickup apparatus (a camera) as an optical device according to anembodiment of the present invention.

FIG. 2A is a graph showing relations between focal lengths and maximumcorrection angles of a first shake correction lens and a second shakecorrection lens among characteristics information stored in an opticalsystem database shown in FIG. 1.

FIG. 2B is a graph showing relations between correction angles and imagedistortions due to eccentric aberration of the first shake correctionlens and the second shake correction lens among characteristicsinformation stored in the optical system database shown in FIG. 1.

FIG. 3A is a graph showing a control of the camera shown in FIG. 1 in animage blur correction effect priority mode.

FIG. 3B is a graph showing a control of the camera shown in FIG. 1 in animage quality priority mode.

FIG. 3C is a graph showing a control of the camera shown in FIG. 1 in amiddle mode.

FIG. 4 is a flowchart showing a shake correction process executed by thecamera shown in FIG. 1.

FIG. 5 is a graph showing relations between shake amounts and shakefrequencies in various shooting methods in the camera shown in FIG. 1.

FIG. 6 is a view showing examples of relationships between shakecorrection modes and camera information in the camera shown in FIG. 1.

DESCRIPTION OF THE EMBODIMENTS

Hereafter, embodiments according to the present invention will bedescribed in detail with reference to the drawings.

FIG. 1 is a block diagram schematically showing a configuration of animage pickup apparatus as an optical device according to an embodimentof the present invention.

The illustrated image pickup apparatus is a digital still camera(referred to as a camera, hereafter), and has an optical system 101 likea photographing lens unit. Then, the optical system 101 is provided witha first shake correction lens 102 and a second shake correction lens103. An optical image is formed onto an image pickup device 104 throughthe optical system 101, and the image pickup device 104 outputs ananalog signal (an image signal) corresponding to the optical image.

The image signal is inputted into an image signal processing unit 105,and the image signal processing unit 105 performs A/D conversion of theimage signal to generate a digital signal (image data), and appliesimage processes, such as white balance adjustment, color (brightness andcolor-difference signal) conversion, and gamma correction, to the imagedata concerned. A system control unit 106 controls the whole camera 100.

For example, the system control unit 106 controls the focal length andthe aperture value of the optical system 101, and controls driving ofthe image pickup device 104.

A shake detection unit 107 detects a motion (shake) of the camera, andsends shake information (a shake detection result) to the system controlunit 106. The shake detection unit 107 is an angular velocity sensor,for example, detects the angular velocities of the motion of the cameraaround three axes (yaw, roll, and pitch), and outputs the angularvelocities concerned to the system control unit 106 as the shakeinformation.

A camera information obtaining unit 108 obtains the camera informationrequired to presume the photographing condition of the camera includingthe above-mentioned shake detection result from the system control unit106. The camera information includes a focal length, shake information,main subject information about a main subject, shutter speed, a shootingmode, etc., for example (here, the information other than the shakeinformation is called shooting information). The system control unit 106generates the shooting information according to analysis of an imageobtained as a result of shooting and according to additional informationadded to the image.

An optical system database 109 stores characteristics that showrelations between correction angles of the first shake correction lens102 and the second shake correction lens 103 and qualities of imagesthat are obtained as results of shootings as characteristicsinformation. It should be noted that the characteristics informationwill be described later.

A shake correction lens determination unit 110 determines which of thefirst shake correction lens 102 and the second shake correction lens 103should be used for the shake correction based on the camera information(particularly the shake information) sent from the camera informationobtaining unit 108 and the characteristics information obtained from theoptical system database 109.

An optical system control unit 111 controls driving of the shakecorrection lens determined by the shake correction lens determinationunit 110 based on the shake information obtained from the camerainformation obtaining unit 108 and position information about the shakecorrection lenses obtained from the first shake correction lens 102 andthe second shake correction lens 103.

In this case, the optical system control unit 111 controls driving ofthe shake correction lens determined by the shake correction lensdetermination unit 110 so as to cancel deviation between a light beamfrom a subject and the optical axis of the optical system caused by theshake. On the other hand, the shake correction lens that is not used forthe shake correction is positioned in an initial state because thedriving amount is zero.

FIG. 2A and FIG. 2B are graphs showing the characteristics informationthat is stored in the optical system database 109 shown in FIG. 1 andthat specifies the relations between the correction angles of the firstshake correction lens and the second shake correction lens and imagequalities. Then, FIG. 2A is a graph showing relations between focallengths and maximum correction angles, and FIG. 2B is a graph showingrelations between correction angles and image distortion amounts due toeccentric aberration.

As shown in FIG. 2A and FIG. 2B, the optical characteristics differbetween the first shake correction lens 102 and the second shakecorrection lens 103. Since the shake correction lens shifts from theoptical axis of the optical system 101 when correcting shake of thecamera, the resolution deteriorates and the image distorts unescapablydue to eccentric aberration.

The relations (first characteristics) between the focal lengths and themaximum correction angles are specified in FIG. 2A. The maximumcorrection angle expresses the maximum shake angle that can be correctedwhile maintaining specified resolution. That is, the larger the maximumcorrection angle is, the higher the stabilization effect (the image blurcorrection effect) is.

The focal length in which the maximum correction angles of the firstshake correction lens 102 and the second shake correction lens 103 arematched is assumed “fa” (referred to as a coincidence focal length,hereafter). In the example shown in FIG. 2A, when the focal length isshorter than the coincidence focal length fa, the stabilization effectof the first correction lens 102 is higher than that of the secondcorrection lens 103 because the maximum correction angle of the firstshake correction lens 102 is larger than that of the second shakecorrection lens 103.

On the other hand, when the focal length is longer than the coincidencefocal length fa, the stabilization effect of the second correction lens103 is higher than that of the first correction lens 102 because themaximum correction angle of the second shake correction lens 103 islarger than that of the first shake correction lens 102.

The relationships (second characteristics) between the correction anglesand the image distortion amounts due to eccentric aberration for thefirst shake correction lens 102 and the second shake correction lens 103are specified in FIG. 2B. It should be noted that the image qualityincreases as the image distortion due to eccentric aberration decreases.

In the example shown in FIG. 2B, the increase of the image distortionamount due to eccentric aberration corresponding to the increase of thecorrection angle of the first shake correction lens 102 is smaller thanthat of the second shake correction lens 103. That is, in any correctionangles, a higher quality image can be obtained by moving the first shakecorrection lens 102 for the shake correction rather than by moving thesecond shake correction lens 103 for the shake correction.

The optical system database 109 stores the characteristics about therespective shake correction lenses shown in FIG. 2A and FIG. 2B as thecharacteristics information. That is, the optical system database 109beforehand stores the data that associates the focal lengths with themaximum correction angles for the first shake correction lens 102 andthe second shake correction lens 103 (FIG. 2A) and the data thatassociates the correction angles with the image distortion amounts dueto eccentric aberration (FIG. 2B).

When the lens characteristics (i.e., the characteristics information)shown in FIG. 2A and FIG. 2B are taken into consideration, since ahigher stabilization effect and a higher quality image can be obtainedby moving the first shake correction lens 102 rather than by moving thesecond shake correction lens 103 when the focal length is shorter thanthe coincidence focal length fa, it is preferable to use the first shakecorrection lens 102 for the shake correction when the focal length isshorter than the coincidence focal length fa.

When the focal length is longer than the coincidence focal length fa onthe other hand, a higher stabilization effect can be obtained by movingthe second shake correction lens 103 rather than by moving the firstshake correction lens 102, but the quality of an image obtained as aresult of shooting is low when the second shake correction lens 103 ismoved for the shake correction.

Accordingly, when the focal length is longer than the coincidence focallength fa, and when a priority is given to the stabilization effect, thesecond shake correction lens 103 is moved for the shake correction.

On the other hand, when a priority is given to the image quality, thefirst shake correction lens 102 is moved for the shake correction. Inthe following description, shake correction modes shall include astabilization effect priority mode that gives a priority to thestabilization effect, an image quality priority mode that gives apriority to the image quality, and the below-mentioned middle mode.

FIG. 3A, FIG. 3B, and FIG. 3C are graphs showing controls performed inthe camera shown in FIG. 1 in the respective shake correction modes.FIG. 3A is a graph showing a control in the stabilization effectpriority mode, and FIG. 3B is a graph showing a control in the imagequality priority mode. Moreover, FIG. 3C is a graph showing a control inthe middle mode.

In FIG. 3A, FIG. 3B, and FIG. 3C, the shake correction lens to be usedfor shake correction is switched between the first shake correction lens102 and the second shake correction lens 103 at a focal length ft(referred to as a change focal length, hereafter). When the focal lengthof the camera (i.e., the optical system 101) is not longer than thechange focal length ft, the first shake correction lens 102 is used forthe shake correction.

On the other hand, when the focal length of the camera exceeds thechange focal length ft, the second shake correction lens 103 is used forthe shake correction.

It should be noted that slant hatching areas 301 in FIG. 3A, FIG. 3B,and FIG. 3C represent movable ranges of the first shake correction lens102 and horizontal hatching areas 302 represent movable ranges of thesecond shake correction lens 103.

In the stabilization effect priority mode shown in FIG. 3A, the changefocal length ft matches the coincidence focal length fa. As a result ofthis, the shake correction can be performed to the maximum correctionangle in any focal length of the camera.

However, since the shake correction is performed using the second shakecorrection lens 103 when the focal length of the camera is longer thanthe coincidence focal length fa as mentioned above, the image distortionamount due to eccentric aberration becomes large, which deteriorates theimage quality somewhat.

In the stabilization effect priority mode, when the camera shake exceedsthe maximum correction angle that can be responded by one shakecompensating lens, both the first shake correction lens and the secondshake correction lens may be moved to extend the maximum correctionangle. However, in this case, the image distortion due to eccentricaberration will be complicated and image quality will deteriorate.

In the image quality priority mode shown in FIG. 3B, the change focallength ft matches the focal length fb at the tele end (i.e., thetelephoto end). As a result of this, since the first shake correctionlens 102 is used for the shake correction in any focal lengths of thecamera, the image distortion amount due to eccentric aberration can bekept small.

However, since the shake correction is performed using the first shakecorrection lens 102 even when the focal length of the camera is longerthan the coincidence focal length fa as mentioned above, the maximumcorrection angle decreases, which deteriorates the stabilization effectsomewhat.

In the middle mode shown in FIG. 3C, the change focal length ft is setin the middle between the coincidence focal length fa and the tele endfocal length fb.

FIG. 4 is a flowchart showing a shake correction process executed by thecamera shown in FIG. 1. It should be noted that the process of theflowchart shown in FIG. 4 is executed under the control by the systemcontrol unit 106.

When the shake correction process is started, the camera informationobtaining unit 108 obtains the camera information (the shakeinformation) from the system control unit 106 (step S401).

Next, the shake correction lens determination unit 110 presumes thephotographing condition in the camera based on the camera informationthat was obtained by the camera information obtaining unit 108. Then,the shake correction lens determination unit 110 determines which of thestabilization effect priority mode and the image quality priority modeis suitable according to the photographing condition, and determines theshake correction mode (step S402). Hereinafter, the shake correctionmode determined in the step S402 is called a determined shake correctionmode.

Next, the shake correction lens determination unit 110 determineswhether the determined shake correction mode is the stabilization effectpriority mode (step S403).

When the determined shake correction mode is the image quality prioritymode (NO in the step S403), the shake correction lens determination unit110 compares the current focal length f with the change focal length ftin the determined shake correction mode, and determines whether thecurrent focal length f is smaller than the change focal length ft (stepS404). When f is smaller than ft (YES in the step S404), the shakecorrection lens determination unit 110 determines to use the first shakecorrection lens 102. Then, the shake correction lens determination unit110 notifies the optical system control unit 111 of the determination.

The optical system control unit 111 performs the shake correction bycontrolling the driving of the first shake correction lens 102 based onthe shake information obtained by the camera information obtaining unit108, i.e., the shake information detected by the shake detection unit107 (step S405). Then, the optical system control unit 111 finishes theshake correction process.

When the determined shake correction mode is the stabilization effectpriority mode on the other hand (YES in the step S403), the shakecorrection lens determination unit 110 compare the current focal lengthf with the change focal length ft, and determines whether the currentfocal length f is smaller than the change focal length ft (step S407).

When the current focal length f is smaller than the change focal lengthft (YES in the step S407), the shake correction lens determination unit110 compares the current shake amount T with the maximum correctionangle T1 of the first shake correction lens, and determines whether thecurrent shake amount T is smaller than the maximum correction angle T1(step S408).

When the current shake amount T is smaller than the maximum correctionangle T1 (YES in the step S408), the shake correction lens determinationunit 110 determines to use the first shake correction lens 102. Then,the shake correction lens determination unit 110 notifies the opticalsystem control unit 111 of the determination.

The optical system control unit 111 performs the shake correction bycontrolling the driving of the first shake correction lens 102 based onthe shake information obtained by the camera information obtaining unit108, i.e., the shake information detected by the shake detection unit107 (step S409). Then, the optical system control unit 111 finishes theshake correction process.

On the other hand, when the current shake amount T is larger than themaximum correction angle T1 (NO in the step S408), the shake correctionlens determination unit 110 determines to use the first shake correctionlens 102 and the second shake correction lens 103. Then, the shakecorrection lens determination unit 110 notifies the optical systemcontrol unit 111 of the determination.

The optical system control unit 111 performs the shake correction bycontrolling so that the correction angle by the first shake correctionlens 102 is T1 and the correction angle by the second shake correctionlens 103 is (T−T1) based on the shake information obtained by the camerainformation obtaining unit 108 (step S410). It should be noted that itis controlled so that (T−T1) is not larger than the maximum correctionangle T2 of the second shake correction lens. Then, the optical systemcontrol unit 111 finishes the shake correction process.

On the other hand, when the current focal length f is larger than thechange focal length ft (NO in the step S407), the shake correction lensdetermination unit 110 compares the current shake amount T with themaximum correction angle T2 of the second shake correction lens based onthe shake information obtained by the camera information obtaining unit108, and determines whether the current shake amount T is smaller thanthe maximum correction angle T2 (step S411).

When the current shake amount T is smaller than the maximum correctionangle T2 (YES in the step S411), the shake correction lens determinationunit 110 determines to use the second shake correction lens 103. Then,the shake correction lens determination unit 110 notifies the opticalsystem control unit 111 of the determination.

The optical system control unit 111 performs the shake correction bycontrolling the driving of the second shake correction lens 103 based onthe shake information obtained by the camera information obtaining unit108, i.e., the shake information detected by the shake detection unit107 (step S412). Then, the optical system control unit 111 finishes theshake correction process.

On the other hand, when the current shake amount T is larger than themaximum correction angle T2 (NO in the step S411), the shake correctionlens determination unit 110 determines to use the first shake correctionlens 102 and the second shake correction lens 103. Then, the shakecorrection lens determination unit 110 notifies the optical systemcontrol unit 111 of the determination.

The optical system control unit 111 performs the shake correction bycontrolling so that the correction angle by the first shake correctionlens 102 is (T−T2) and the correction angle by the second shakecorrection lens 103 is T2 based on the shake information obtained by thecamera information obtaining unit 108 (step S413). It should be notedthat it is controlled so that (T−T2) is smaller than the maximumcorrection angle T1 of the first shake correction lens. Then, theoptical system control unit 111 finishes the shake correction process.

The details of the shake correction mode determination process in thestep S402 in FIG. 4 will be described.

The shake correction lens determination unit 110 estimates the shootingmethod in the camera based on the shake information among the camerainformation, and determines the priority of the stabilization effect andthe image quality according to this estimated result.

FIG. 5 is a graph showing relations between shake amounts and shakefrequencies in various shooting methods in the camera shown in FIG. 1.

As shown in FIG. 5, a photographer takes a picture with the camera bywalking shooting, by one-handed shooting, or by a two-handed shooting,for example. Then, the relations between shake amounts and shakefrequencies are different among the waking shooting, the one-handedshooting, and the two-handed shooting.

In the walking shooting, the shake amount becomes extremely large in alow frequency range as shown by a curve (c), and the shake amount islarger than that in the one-handed shooting and the two-handed shootingover the entire frequency range (from the low frequency range to thehigh frequency range).

In the two-handed shooting on the other hand, the shake amount is smallover the entire frequency range (from the low frequency range to thehigh frequency range) as shown by a curve (a). Moreover, the shakeamount in the one-handed shooting (a curve (b)) takes a middle positionbetween the shake amount in the walking shooting (the curve (c)) and theshake amount in the two-handed shooting (the curve (a)) over the entirefrequency range (from the low frequency range to the high frequencyrange).

As understood easily from FIG. 5, the shake correction lensdetermination unit 110 obtains the shake amount by detecting one lowfrequency band (2 Hz through 3 Hz, for example) in the curve thatrepresents the relation between the shake amount and the frequency inorder to determine which of the walking shooting, the one-handedshooting, and the two-handed shooting matches the current shootingmethod. When the shake amount is large, the shake correction lensdetermination unit 110 determines that the current shooting method isthe walking shooting.

Moreover, when the shake amount is medium, the shake correction lensdetermination unit 110 determines that the current shooting method isthe one-handed shooting. When the shake amount is small, the shakecorrection lens determination unit 110 determines that the currentshooting method is the two-handed shooting.

A first shake threshold and a second shake threshold are set to theshake correction lens determination unit 110 (the first shake-thresholdis larger than the second shake threshold). Then, when the shake amountis not smaller than the first shake threshold, the shake correction lensdetermination unit 110 determines that the current shooting method isthe walking shooting.

Moreover, when the shake amount is smaller than the first shakethreshold and is not smaller than the second shake threshold, the shakecorrection lens determination unit 110 determines that the currentshooting method is the one-handed shooting. Furthermore, when the shakeamount is smaller than the second shake threshold, the shake correctionlens determination unit 110 determines that the current shooting methodis the two-handed shooting.

When the shooting method is the walking shooting, the shake correctionlens determination unit 110 gives priority to the stabilization effectrather than the image quality, because it is anticipated that a largeshake will occur with high frequency. On the other hand, when theshooting method is the two-handed shooting, the shake correction lensdetermination unit 110 gives priority to the image quality rather thanthe stabilization effect, because it is anticipated that a large shakewill occur with low frequency,

FIG. 6 is a view showing examples of relationships between shakecorrection modes and camera information in the camera shown in FIG. 1.

In the step S401 in FIG. 4, at least one of main subject information,shutter speed, and a shooting mode may be obtained other than the shakeinformation detected by the shake detection unit 107.

The main subject information expresses a person likeness, distance froma camera to a main subject, a size of a main subject, and a motion of amain subject, for example. When a main subject is a person's face, thesystem control unit 106 obtains the information that shows the color andoutline of the main subject according to the image data obtained fromthe image signal processing unit 105 using a known method. Then, thesystem control unit 106 determines the person likeness and the size ofthe main subject using the information concerning the color and outlineof the main subjects.

Moreover, although not shown in FIG. 1, the system control unit 106finds the distance from the camera to the main subject according to theposition of the focus lens detected by an automatic focus detectionprocess, for example. Furthermore, the system control unit 106 detects amotion vector between image frames with a known method and finds amotion of a main subject according to the motion vector concerned.

As mentioned above, the main subject information includes theinformation that expresses a person likeness, distance from a camera toa main subject, a size of a main subject, and a motion of a mainsubject. Since human being has very high cognition to a person's face,human being feels uncomfortable when a person's face is distortedslightly. Accordingly, a distortion is conspicuous for a user when asubject has a high person likeness.

On the other hand, in a subject like landscape other than a person, amotion of the entire image due to camera shake is conspicuous ratherthan distortion. Accordingly, with respect to the person likeness of asubject, it is preferable to give a priority to image quality ratherthan stabilization effect as the person likeness increases.

Moreover, distortion in a main subject area is conspicuous rather than amotion of the entire image due to camera shake as the distance to themain subject becomes shorter. Accordingly, with respect to the distanceto the main subject, it is preferable to give a priority to imagequality rather than stabilization effect as the distance to the mainsubject shortens.

Moreover, distortion in a main subject area is conspicuous rather than amotion of the entire image due to camera shake as the size of the mainsubject becomes larger. Accordingly, with respect to the size of themain subject, it is preferable to give a priority to image qualityrather than stabilization effect as the size of the main subjectenlarges.

Moreover, distortion in a main subject area is conspicuous rather than amotion of the entire image due to camera shake as the motion of the mainsubject becomes small. Accordingly, with respect to the motion of themain subject, it is preferable to give a priority to image qualityrather than stabilization effect as the motion of the main subjectbecomes small.

With respect to a shutter speed, when the shutter speed is slow, aneffect of accumulated blur in the image pickup device 104 becomes large.Accordingly, a motion of the entire image due to camera shake becomesconspicuous rather than distortion of a partial image.

On the other hand, when shutter speed is fast, the effect of theaccumulated blur in the image pickup device 104 becomes small.Accordingly, distortion of an image becomes conspicuous rather than amotion of the entire image. Accordingly, it is preferable to give apriority to image quality rather than stabilization effect as theshutter speed is faster.

With respect to the shooting mode, there is high possibility of shootinga person in a portrait mode, and there is high possibility of shootinglandscape in a landscape mode, for example. Accordingly, as mentionedfor the person likeness of the main subject, it is preferable to give apriority to image quality rather than stabilization effect in theportrait mode, and it is preferable to give a priority to stabilizationeffect rather than image quality in the landscape mode.

Moreover, when a camera is attached to a tripod, it is preferable togive a priority to image quality rather than stabilization effect,because the camera shake becomes extremely small as compared with ahand-holding shooting.

With respect to the shooting mode, the system determines which of thestabilization effect and the image quality should have a priority whileanticipating a photographing condition according to the shoot mode. Itshould be noted that the system determines that it is impossible to ashooting mode in which various photographing conditions are assumed.

Incidentally, as shown in FIG. 6, when camera information has aplurality of items (i.e., a plurality of kinds of information), thedetermination results about which of the stabilization effect and theimage quality should have a priority may differ for the respectiveitems. In such a case, the system control unit 106 should determinewhich of the stabilization effect and the image quality has a priorityaccording to a majority decision by weighting the determination resultscorresponding to the items.

In this case, if the shake correction mode is changed frequently, thecontinuity of images may be spoiled, as a result of switching the shakecorrection lenses even if an image is captured in the same focal length.

Accordingly, when a shake correction mode that is suitable for thephotographing condition is determined for every frame, the systemcontrol unit 106 changes a shake correction mode only when the samedetermination results are obtained continuously for a predeterminednumber of frames with reference to the shake correction mode about thepast frames, for example.

In this way, since the embodiment of the present invention controls aplurality of shake correction lenses selectively according to thephotographing condition, the stabilization effect and the image qualitycan be consistent. As a result, the eccentric aberration can be reduced,and the image blur can be reduced.

Although the embodiments of the invention have been described, thepresent invention is not limited to the above-mentioned embodiments, thepresent invention includes various modifications as long as the conceptof the invention is not deviated.

For example, the functions of the above mentioned embodiments may beachieved as a control method that is executed by an image pickupapparatus. Moreover, the functions of the above mentioned embodimentsmay be achieved as a control program that is executed by a computer withwhich the image pickup apparatus is provided. It should be noted thatthe control program is recorded into a computer-readable storage medium,for example.

The optical device of the present invention includes an interchangeablelens alone, a camera alone, and the image pickup apparatus that isprovided with the optical system 101 and the image pickup device 104.The image pickup apparatus in the FIG. 1 of the present invention hasthe optical system 101 and the image pickup device 104.

Although the interchangeable lens includes the optical system 101, itdoes not include the image pickup device 104. Although the camera doesnot include the optical system 101, it includes the image pickup device104.

Other Embodiments

Embodiments of the present invention can also be realized by a computerof a system or apparatus that reads out and executes computer executableinstructions recorded on a storage medium (e.g., non-transitorycomputer-readable storage medium) to perform the functions of one ormore of the above-described embodiment(s) of the present invention, andby a method performed by the computer of the system or apparatus by, forexample, reading out and executing the computer executable instructionsfrom the storage medium to perform the functions of one or more of theabove-described embodiment(s). The computer may comprise one or more ofa central processing unit (CPU), micro processing unit (MPU), or othercircuitry, and may include a network of separate computers or separatecomputer processors. The computer executable instructions may beprovided to the computer, for example, from a network or the storagemedium. The storage medium may include, for example, one or more of ahard disk, a random-access memory (RAM), a read only memory (ROM), astorage of distributed computing systems, an optical disk (such as acompact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™),a flash memory device, a memory card, and the like.

While the present invention has been described with reference toexemplary embodiments, it is to be understood that the invention is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all such modifications and equivalent structures andfunctions.

This application claims the benefit of Japanese Patent Applications No.2013-111953, filed May 28, 2013, and No. 2014-056232, filed Mar. 19,2014, which are hereby incorporated by reference herein in theirentireties.

What is claimed is:
 1. An optical device comprising: a shake detectionunit; a face detection unit; a first shake correction unit configured tocorrect image blur optically based on a shake amount that is detected bysaid shake detection unit; and a second shake correction unit configuredto correct image blur optically based on a shake amount that is detectedby said shake detection unit, wherein the image blur correction effectof said second shake correction unit is higher than that of said firstshake correction unit, and image distortion amount with resect to acorrection angle of said first shake correction unit is smaller thanthat of said second shake correction unit, wherein the image blur isoptically corrected using said first shake correction unit whenreliability of a face detection result by said face detection unit isnot lower than a threshold, and wherein the image blur is opticallycorrected using said second shake correction unit when the reliabilityof the face detection result by said face detection unit is lower thanthe threshold.
 2. An optical device comprising: a shake detection unit;a subject distance detection unit; a first shake correction unitconfigured to correct image blur optically based on a shake amount thatis detected by said shake detection unit; and a second shake correctionunit configured to correct image blur optically based on a shake amountthat is detected by said shake detection unit, wherein the image blurcorrection effect of said second shake correction unit is higher thanthat of said first shake correction unit, and image distortion amountwith respect to a correction angle of said first shake correction unitis smaller than that of said second shake correction unit, wherein theimage blur is optically corrected using said second shake correctionunit when subject distance detected by said subject distance detectionunit is not shorter than a threshold, and wherein the image blur isoptically corrected using said first shake correction unit when thesubject distance detected by said subject distance detection unit isshorter than the threshold.
 3. An optical device comprising: a shakedetection unit; a subject size detection unit; a first shake correctionunit configured to correct image blur optically based on a shake amountthat is detected by said shake detection unit; and a second shakecorrection unit configured to correct image blur optically based on ashake amount that is detected by said shake detection unit, wherein theimage blur correction effect of said second shake correction unit ishigher than that of said first shake correction unit, and imagedistortion amount with respect to a correction angle of said first shakecorrection unit is smaller than that of said second shake correctionunit, wherein the image blur is optically corrected using said secondshake correction unit when subject size detected by said subject sizedetection unit is smaller than a threshold, and wherein the image bluris optically corrected using said first shake correction unit when thesubject size detected by said subject size detection unit is not smallerthan the threshold.
 4. An optical device comprising: a shake detectionunit; a subject motion detection unit; a first shake correction unitconfigured to correct image blur optically based on a shake amount thatis detected by said shake detection unit; and a second shake correctionunit configured to correct image blur optically based on a shake amountthat is detected by said shake detection unit, wherein the image blurcorrection effect of said second shake correction unit is higher thanthat of said first shake correction unit, and image distortion amountwith respect to a correction angle of said first shake correction unitis smaller than that of said second shake correction unit, wherein theimage blur is optically corrected using said second shake correctionunit when a subject motion detected by said subject motion detectionunit is not smaller than a threshold, and wherein the image blur isoptically corrected using said first shake correction unit when thesubject motion detected by said subject motion detection unit is smallerthan the fifth threshold.
 5. An optical device comprising: a shakedetection unit; a first shake correction unit configured to correctimage blur optically based on a shake amount that is detected by saidshake detection unit; and a second shake correction unit configured tocorrect image blur optically based on a shake amount that is detected bysaid shake detection unit, wherein image blur correction effect of saidsecond shake correction unit is hi her than that of said first shakecorrection unit, and image distortion amount with respect to acorrection angle of said first shake correction unit is smaller thanthat of said second shake correction unit, wherein the image blur isoptically corrected using said first shake correction unit when shutterspeed is faster than a threshold, and wherein the image blur isoptically corrected using said second shake correction unit when theshutter speed is slower than the threshold.
 6. An optical devicecomprising: a shake detection unit; a first shake correction unitconfigured to correct image blur optically based on a shake amount thatis detected by said shake detection unit; and a second shake correctionunit configured to correct image blur optically based on a shake amountthat is detected by said shake detection unit, wherein the image blurcorrection effect of said second shake correction unit is higher thanthat of said first shake correction unit, and image distortion amountwith respect to a correction angle of said first shake correction unitis smaller than that of said second shake correction unit, wherein theimage blur is optically corrected using said first shake correction unitin a portrait mode, and wherein the image blur is optically correctedusing said second shake correction unit in a landscape mode.
 7. Acontrol method for an optical device comprising: a shake detection step;a face detection step; a first shake correction step of correcting imageblur optically based on a shake amount that is detected in said shakedetection step; a second shake correction step of correcting image bluroptically based on a shake amount that is detected in said shakedetection step, wherein an image blur correction effect in said secondshake correction step is higher than that in said first shake correctionstep, and an image distortion amount with respect to a correction anglein said first shake correction step is smaller than that in said secondshake correction step, wherein the image blur is optically corrected insaid first shake correction step when reliability of a face detectionresult in said face detection step is not lower than a threshold, andwherein the image blur is optically corrected in said second shakecorrection step when the reliability of the face detection result insaid face detection step is lower than the threshold.
 8. A controlmethod for an optical device comprising: a shake detection step; asubject distance detection step; a first shake correction step ofcorrecting image blur optically based on a shake amount that is detectedin said shake detection step; and a second shake correction step ofcorrecting image blur optically based on a shake amount that is detectedin said shake detection step, wherein an image blur correction effect insaid second shake correction step is higher than that in said firstshake correction step, and an image distortion amount with respect to acorrection angle in said first shake correction step is smaller thanthat in said second shake correction step, wherein the image blur isoptically corrected in said second shake correction step when a subjectdistance detected in said subject distance detection step is not shorterthan a threshold, and wherein the image blur is optically corrected insaid first shake correction step when the subject distance detected insaid subject distance detection step is shorter than the threshold.
 9. Acontrol method for an optical device comprising: a shake detection step;a subject size detection step; a first shake correction step ofcorrecting image blur optically based on a shake amount that is detectedin said shake detection step; and a second shake correction stepconfigured to correct image blur optically based on a shake amount thatis detected in said shake detection step, wherein an image blurcorrection effect in said second shake correction step is higher thanthat in said first shake correction step, and an image distortion amountwith respect to a correction angle in said first shake correction stepis smaller than that in said second shake correction step, wherein theimage blur is optically corrected in said second shake correction stepwhen a subject size detected in said subject size detection step issmaller than a threshold, and wherein the image blur is opticallycorrected in said first shake correction step when the subject sizedetected in said subject size detection step is not smaller than thethreshold.
 10. A control method for an optical device comprising: ashake detection step; a subject motion detection step; a first shakecorrection step of correcting image blur optically based on a shakeamount that is detected in said shake detection step; and a second shakecorrection step of correcting image blur optically based on a shakeamount that is detected in said shake detection step, wherein an imageblur correction effect in said second shake correction step is higherthan that in said first shake correction step, and an image distortionamount with respect to a correction angle in said first shake correctionstep is smaller than that in said second shake correction step, whereinthe image blur is optically corrected in said second shake correctionstep when a subject motion detected in said subject motion detectionstep is not smaller than a threshold, and wherein the image blur isoptically corrected in said first shake correction step when a subjectmotion detected in said subject motion detection step is smaller thanthe threshold.
 11. A control method for an optical device comprising: ashake detection step; a first shake correction step of correcting imageblur optically based on a shake amount that is detected in said shakedetection step; and a second shake correction step of correcting imageblur optically based on a shake amount that is detected in said shakedetection step, wherein an image blur correction effect in said secondshake correction step is higher than that in said first shake correctionstep, and an image distortion amount with respect to a correction anglein said first shake correction step is smaller than that in said secondshake correction step, wherein the image blur is optically corrected insaid first shake correction step when shutter speed is faster than athreshold, and wherein the image blur is optically corrected in saidsecond shake correction step when the shutter speed is slower than thethreshold.
 12. A control method for an optical device comprising: ashake detection step; a first shake correction step of correcting imageblur optically based on a shake amount that is detected in said shakedetection step; and a second shake correction step configured to correctimage blur optically based on a shake amount that is detected in saidshake detection step, wherein an image blur correction effect in saidsecond shake correction step is higher than that in said first shakecorrection step, and an image distortion amount with respect to acorrection angle in said first shake correction step is smaller thanthat in said second shake correction step, wherein the image blur isoptically corrected in said first shake correction step in a portraitmode, and wherein the image blur is optically corrected in said secondshake correction step in a landscape mode.
 13. A non-transitorycomputer-readable storage medium storing a control program causing acomputer to execute a control method for an optical device, the controlmethod comprising: a shake detection step; a face detection step; afirst shake correction step of correcting image blur optically based ona shake amount that is detected in said shake detection step; a secondshake correction step of correcting image blur optically based on ashake amount that is detected in said shake detection step, wherein animage blur correction effect in said second shake correction step ishigher than that in said first shake correction step, and an imagedistortion amount with respect to a correction angle in said first shakecorrection step is smaller than that in said second shake correctionstep, wherein the image blur is optically corrected in said first shakecorrection step when reliability of a face detection result in said facedetection step is not lower than a threshold, and wherein the image bluris optically corrected in said second shake correction step when thereliability of the face detection result in said face detection step islower than the threshold.
 14. A non-transitory computer-readable storagemedium storing a control program causing a computer to execute a controlmethod for an optical device, the control method comprising: a shakedetection step; a subject distance detection step; a first shakecorrection step of correcting image blur optically based on a shakeamount that is detected in said shake detection step; and a second shakecorrection step of correcting image blur optically based on a shakeamount that is detected in said shake detection step, wherein an imageblur correction effect in said second shake correction step is higherthan that in said first shake correction step, and an image distortionamount with respect to a correction angle in said first shake correctionstep is smaller than that in said second shake correction step, whereinthe image blur is optically corrected in said second shake correctionstep when a subject distance detected in said subject distance detectionstep is not shorter than a threshold, and wherein the image blur isoptically corrected in said first shake correction step when the subjectdistance detected in said subject distance detection step is shorterthan the threshold.
 15. A non-transitory computer-readable storagemedium storing a control program causing a computer to execute a controlmethod for an optical device, the control method comprising: a shakedetection step; a subject size detection step; a first shake correctionstep of correcting image blur optically based on a shake amount that isdetected in said shake detection step; and a second shake correctionstep configured to correct image blur optically based on a shake amountthat is detected in said shake detection step, wherein an image blurcorrection effect in said second shake correction step is higher thanthat in said first shake correction step, and an image distortion amountwith respect to a correction angle in said first shake correction stepis smaller than that in said second shake correction step, wherein theimage blur is optically corrected in said second shake correction stepwhen a subject size detected in said subject size detection step issmaller than a threshold, and wherein the image blur is opticallycorrected in said first shake correction step when the subject sizedetected in said subject size detection step is not smaller than thethreshold.
 16. A non-transitory computer-readable storage medium storinga control program causing a computer to execute a control method for anoptical device, the control method comprising: a shake detection step; asubject motion detection step; a first shake correction step ofcorrecting image blur optically based on a shake amount that is detectedin said shake detection step; and a second shake correction step ofcorrecting image blur optically based on a shake amount that is detectedin said shake detection step, wherein an image blur correction effect insaid second shake correction step is higher than that in said firstshake correction step, and an image distortion amount with respect to acorrection angle in said first shake correction step is smaller thanthat in said second shake correction step, wherein the image blur isoptically corrected in said second shake correction step when a subjectmotion detected in said subject motion detection step is not smallerthan a threshold, and wherein the image blur is optically corrected insaid first shake correction step when a subject motion detected in saidsubject motion detection step is smaller than the threshold.
 17. Anon-transitory computer-readable storage medium storing a controlprogram causing a computer to execute a control method for an opticaldevice, the control method comprising: a shake detection step; a firstshake correction step of correcting image blur optically based on ashake amount that is detected in said shake detection step; and a secondshake correction step of correcting image blur optically based on ashake amount that is detected in said shake detection step, wherein animage blur correction effect in said second shake correction step ishigher than that in said first shake correction step, and an imagedistortion amount with respect to a correction angle in said first shakecorrection step is smaller than that in said second shake correctionstep, wherein the image blur is optically corrected in said first shakecorrection step when shutter speed is faster than a threshold, andwherein the image blur is optically corrected in said second shakecorrection step when the shutter speed is slower than the threshold. 18.A non-transitory computer-readable storage medium storing a controlprogram causing a computer to execute a control method for an opticaldevice, the control method comprising: a shake detection step; a firstshake correction step of correcting image blur optically based on ashake amount that is detected in said shake detection step; and a secondshake correction step configured to correct image blur optically basedon a shake amount that is detected in said shake detection step, whereinan image blur correction effect in said second shake correction step ishigher than that in said first shake correction step, and an imagedistortion amount with respect to a correction angle in said first shakecorrection step is smaller than that in said second shake correctionstep, wherein the image blur is optically corrected in said first shakecorrection step in a portrait mode, and wherein the image blur isoptically corrected in said second shake correction step in a landscapemode.